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SENSORY  MECHANISM  MODELING 


1.0  INTRODUCTION 

Reliance  on  aircraft  simulation,  both  for  pilot 
training  and  experimentation,  is  expanding  rapidly. 

There  exists  a need  to  learn  more  about  human  sensory 
systems  in  order  to  discover  what  motion  cues  are  im- 
portant for  training,  face  validity,  and  manual  control 
research  in  a simulation,  and  how  best  to  provide  them. 
Current  motion  cueing  systems,  for  instance,  often 
emphasize  matching  simulator  motion  with  aircraft  motion 
and  use  "washout"  logic  to  keep  motion  within  hardware 
limitations.  Although  physiological  thresholds  and 
sensitive  frequencies  are  sometimes  considered,  the 
special  characteristics  of  the  pilot's  sensory  system 
are  not  used  to  full  advantage.  Utilization  of  these 
characteristics  may  result  in  more  effective  simulations, 
but  will  require  some  understanding  of  how  the  various 
sensors  interact  to  produce  a certain  overall  sensation 
of  orientation  and  motion.  The  purpose  of  this  sensory 
mechanism  modeling  project  is  to  further  the  understand- 
ing of  multi-sensory  integration  in  spatial  orientation, 
and  to  aid  in  its  application  to  simulator  requirements. 

Currently  the  "fidelity,"  or  realism,  of  a simulated 
maneuver  is  evaluated  either  by  subjective  pilot  opinion, 
or  by  comparing  aircraft  specific  forces,  accelerations, 
visual  field  motions,  and  tactile  forces,  with  those  pro- 
duced by  the  simulator.  In  our  view,  the  appropriate 
comparison  should  be  between  the  pilot's  perception  of 
motion  in  the  simulator  and  aircraft,  rather  than  between 
the  simulator  and  aircraft  motions  themselves.  Figure 

1.1  shows  a scheme  that  uses  sensory  system  models  to 
compare  perception  in  the  simulator  to  that  which  would 
be  produced  in  the  aircraft.  Several  elements  shown  in 
this  block  diagram  are  under  the  control  of  the  simula- 
tor designer  and  user,  including,  for  example,  the  limits 
on  a motion  drive  and  the  logic  used  to  control  it  in 
conjunction  with  visual  and  tactile  cues.  In  order  to 
specify  these  for  sufficient  simulator  fidelity,  however, 
the  block  labelled  "Motion  Sensing  Model  of  Pilot"  must 
be  developed.  That  development  is  the  subject  of  this 
research . 

In  addition  to  the  model  development,  a number  of 
important  ancillary  issues  are  raised.  For  example,  how 
much  realism,  or  fidelity,  is  necessary  for  a given  pur- 
pose, such  as  pilot  training  or  aircraft  handling  quality 
evaluation?  What  is  the  least  amount  of  simulator  motion 
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Figure  1.1  Comparison  of  sensation  in  real  aircraft  and  simulator  based 
on  pilot  Sensory  Mechanism  Models. 


necessary  to  achieve  a given  degree  of  fidelity?  How  much 
simulator  motion  can  be  "traded"  for  more  compelling  visual 
scene  displays,  more  elaborate  tactile  force  devices,  etc? 
All  of  these  questions  demand  a greater  understanding  of 
the  underlying  sensory  mechanisms,  and  the  overall  affect 
of  multisensory  stimulation. 


1.1  Summary 


The  specific  objective  of  the  work  described  by  this 
report  has  been  to  create  a unified,  or  composite,  model 
for  motion  and  orientation  perception  able  to  integrate 
four  sensory  modalities:  vestibular,  visual,  propriocep- 
tive, and  tactile.  Theoretical  models  for  nearly  all  the 
individual  sensor  systems  exist  in  the  literature,  based 
on  varying  amounts  of  data,  and  in  the  case  of  the  vestibu- 
lar and  visual  systems  interaction  between  modalities  has 
been  studied  as  well.  Data  relating  mechanoreceptor  func- 
tion to  perceived  motion  and  orientation  is  relatively 
sparse,  and  a computer  literature  search  has  been  conducted 
to  identify  available  information  in  this  area.  Although 
there  are  many  gaps  in  our  knowledge  of  all  sensory  modes, 
it  is  felt  that  there  is  now  enough  information  to  warrant 
a first  attempt  at  a unified  perception  model  with  the  goal 
of  making  reasonable  predictions  of  subjective  orientation. 

The  biological  central  processor,  charged  with  inte- 
grating information  from  various  sensors,  may  have  evolved 
to  perform  something  akin  to  an  optimal  estimation  process. 
Under  certain  linearity  and  noise  spectrum  assumptions, 
the  least  mean  squared  error  estimator  is  the  well  known 
Kalman  filter.  Although  nonlinear  processes  may  also 
play  a part,  it  was  decided  to  model  integration  of  the 
various  information  channels  with  a Kalman  filter  blending 
approach. 

An  internal  model,  representing  the  central  processor's 
view  of  the  relation  between  biological  sensors  and  the 
outside  world,  is  used  to  derive  optimal  gains  for  a steady- 
state  Kalman  filter.  The  Kalman  filter  is  then  used  to 
process  signals  from  the  individual  sensor  system  models, 
producing  an  estimate  of  state. 

A FORTRAN  IV  computer  program  has  been  written  to 
implement  the  proposed  model,  and  is  designed  to  output 
time  history  predictions  of  orientation  and  motion  sensa- 
tion given  a time  domain  stimulus  profile.  Since  it  is 
intended  as  a research  tool,  the  program  has  been  written 
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in  as  flexible  a form  as  possible  allowing  the  model  struc- 
ture to  be  changed  or  adjusted  easily. 

Employing  only  vestibular  sensor  components  (semicir- 
cular canals  and  otoliths) , the  model  has  been  exercised 
with  yaw  step  acceleration,  linear  step  acceleration,  and 
with  rapid  pitch  to  a constant  pitch  angle.  All  stimuli 
were  above  threshold  levels  and  threshold  effects  have 
not  yet  been  considered.  Initial  results  appear  quite 
promising  and  are  qualitatively  consistent  with  psycho- 
physical data.  In  the  case  of  yaw  step  acceleration, 
which  stimulates  only  the  semicircular  canals,  the  model 
predicts  an  initially  accurate  perception  of  yaw  velocity, 
which  then  levels  off  and  decays.  The  time  course  is 
consistent  with  experimental  data.  The  step  in  forward 
linear  acceleration  is  "felt"  by  the  model  as  an  initial 
acceleration  which  rapidly  decays  and  is  replaced  by  a 
pitched-back  sensation.  This  phenomena  is  well  known 
during  aircraft  catapult  launches.  When  the  stimulus  is 
a true  pitch-back,  the  same  steady-state  perception  re- 
sults, but  the  time  course  of  perceived  pitch  orientation 
closely  follows  true  pitch  orientation.  The  change  in 
specific  force  direction  is  no  longer  felt  as  a large 
initial  acceleration.  This  is  also  consistent  with  known 
human  responses. 

Model  exercise  up  to  this  point,  although  encouraging, 
has  been  very  preliminary.  Additional  work  is  needed  to 
test  threshold  phenomena  and  to  match  quantitative  model 
responses  with  psychophysical  data.  Model  parameters  prob- 
ably will  need  to  be  adjusted  or  "tuned"  so  that  response 
time  constants  and  magnitudes  fit  experimental  data  as 
closely  as  possible.  As  of  this  writing,  interaction  of 
visual,  tactile  and  proprioceptive  sensors  with  the  semi- 
circular canals  and  otoliths  has  not  been  tested.  Work 
is  ongoing  to  implement  these  additional  modalities  and 
to  make  any  model  modifications  indicated  by  the  results. 


1.2  Report  Organization 

This  report  is  divided  into  six  sections.  Section 
2.0  describes  a computer  literature  search  for  mechano- 
receptor  data.  The  references  generated  by  the  search 
are  listed,  by  categories,  in  Appendix  A. 

Section  3.0  details  pertinent  knowledge  about  each 
of  the  four  sensory  modalities  under  consideration,  and 
presents  our  modeling  approach  to  each  individual  sensor 
system.  The  modalities  being  considered  are;  visual, 
vestibular,  tactile  and  proprioceptive. 
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Section  4.0  is  devoted  to  the  uni fied  model.  First, 
three  previous  models  that  integrate  two  or  more  sensory 


modalities  are  described  very  briefly  (Section  4.1).  Next, 
our  approach  to  the  current  effort  is  discussed  (Section 
4.2),  followed  by  a detailed  description  of  the  proposed 
"unified  model"  (Section  4.3). 

Section  5.0  presents  and  discusses  results  so  far 
obtained  from  a computer  implementation  of  the  model. 

System  matrices  and  parameters  used  to  generate  these 
results  are  listed  in  Appendix  B.  Conclusions  appear  in 
Section  6.0. 


i 


1 


2.0  LITERATURE  SEARCH 


A computer  literature  search  was  conducted  to  identify 
available  material  in  the  area  of  neural  mechanoreceptor 
systems.  The  NASIC  service  was  used  to  search  three  files: 
MEDLINE  (Index  Medicus) , NTIS  (Government  reports) , and 
PSYCHABS  (Psychological  Abstracts) . In  addition  to  these 
sources  the  Defense  Documentation  Center  (DDC)  service  was 
employed. 

Some  of  the  )cey  words  used  in  the  searches  were: 

Perceptual  Orientation 
Space  perception 
Space  orientation 
Kinesthetic  perception 
Cutaneous  Sense 
Proprioception 
Tactile 
Haptic 

Vibrotactile 

Mechanoreceptor 

Pacini  corpuscles 

Golgi  and  Mazzoni  corpuscles 

Neuromuscular  spindles 

The  descriptive  paragraph  sent  to  the  DDC  was: 

"We  are  seardhing  for  literature  describing  human  meahano- 
reoeptor  systems  and  the  perceptions  (sensations)  caused 
by  stimulation  of  mechanore cep  tors . We  are  especially 
interested  in  models  relating  mechanical  stimulation  to 
resulting  perception,  or  to  afferent  nerve  responses  from 
tactile  and  proprioceptive  receptors . Of  even  more 
specific  interest  is  work  relating  sensation  of  motion 
and  orientation  to  mechanoreceptor  stimulation.  The 
heading  'Mechanoreceptor'  may  include  such  subheadings 
as  cutaneous  sensors,  tactile  receptor,  proprioceptor, 
haptic  sensor,  deep  pressure  sensor;  or  mort.  specifically 
Pacini  corpuscle,  Mazzoni  corpuscle,  Iggo  corpuscles, 
muscle  spindle,  Golgi  tendon  organ,  neuromuscular  spindles, 
eta.  " 
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Table  2.1  specifies  the  total  number  of  references 
generated  by  each  search  and  the  number  of  references 
considered  pertinent  after  inspection  (in  the  latter 
category  duplicate  references  are  counted  only  for  the 
first  index  in  which  they  were  found) . Copies  of  pertin- 
ent references  were  obtained  and  organized  by  category 
(see  Table  2.2).  Table  2.2  includes  secondary  references 
cited  by  other  articles.  All  references  generated  by  this 
search  are  listed  by  categories  in  Appendix  A. 
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COMPUTER  LITERATURE  SEARCHES 


3.0  SENSOR  SUBSYSTEMS 

3.1  Visual  System 

3.1.1  Scope  of  the  Visual  Cues  Considered 

Of  the  wide  variety  of  visual  cues  available  to  the 
pilot  in  simulation  this  section  considers  only  one  as- 
pect, namely  the  sensation  of  continuous  motion,  or  of 
steady  pitch  or  roll  angle,  induced  by  the  movement  of 
a large  field  visual  scene.  It  specifically  excludes  two 
large  and  important  classes  of  visual  cues.  One  is  in- 
formation available  to  the  pilot  on  his  display  instru- 
ments, such  as  the  artificial  horizon  or  rate  of  turn 
indicator.  The  other  is  information  from  specific  exter- 
nal visual  field  structure,  such  as  an  horizon. 

Sufficient  attention  has  been  devoted  to  the  instru- 
ment flight  rules  (IFR)  case  in  the  manual  control  liter- 
ature that  one  can  safely  assume  that  those  models  are 
valid  for  perception  of  movement.  Specifically,  the  pilot 
is  assumed  able  to  perceive,  with  a processing  time  of  the 
order  of  100  to  300  msecs,  each  state  variable  explicitly 
displayed  on  a dial  or  other  indicator,  and  its  first 
derivative.  The  approximate  observation  noises  associated 
with  these  indications  is  20  db  below  the  signal  level 
(Curry,  Hoffman  & Young,  1976;  Kleinman,  Baron,  & Levison, 
1970)  . 

The  visual  cues  considered  in  this  section  are  limited 
to  out  the  window  visual  scenes  as  provided  in  an  aircraft 
or  in  a wide  field  visual  scene  flight  simulator.  They  do 
not,  however,  include  any  elements  in  the  structure  of  the 
scene  such  as  recognizable  landmarks,  orientation  cues,  or 
even  the  horizon  line.  The  descriptions  are  limited  to 
the  peripheral  motion  cues  which  are  equivalent  to  the 
passage  of  stars  or  clouds  in  a wide  field  simulation. 


3.1.2  Characteristics  of  Vection 


The  visually  induced  effects  on  orientation  and  motion 
perception  are  referred  to  in  general  as  "vection,"  with 
circularvection  referring  to  visually  induced  motion  in  yaw 
and  linearvection  referring  to  visually  induced  translatory 
motion.  The  common  experience  of  linearvection  is  the  il- 
lusion of  moving  backwards  while  actually  stationary  when 
the  adjacent  train  in  a station  begins  to  slowly  move  for- 
ward, or  when  the  neighboring  car  at  a stop  light  begins  to 
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creep  forward.  Circularvection , or  a sustained  sensation 
of  yaw  rate  when  the  entire  visual  field  rotates  about  a 
vertical  axis,  is  somewhat  less  common  but  is  experienced 
by  many  in  360°  motion  picture  theaters,  and  especially  in 
good  wide  field  visual  simulators.  Least  well  known  of  all 
are  the  phenomena  of  visually  induced  pitch  or  roll  result- 
ing from  a steady  pitch  or  roll  rate  of  the  entire  visual 
surround.  The  interest  in  these  phenonena  has  increased 
markedly  over  the  past  five  years  resulting  in  a great  deal 
of  quantitative  data  on  all  forms  of  vection,  and  attempts 
to  understand  the  interaction  between  visually  induced 
motion  and  vestibular  responses.  Some  general  facts  can 
be  summarized  as  they  apply  to  all  forms  of  visually  in- 
duced motion: 

1.  The  peripheral,  rather  than  the  central  visual 
fields,  must  be  stimulated. 

2 . Background  stimulation  is  more  important  than 
foreground  stimulation. 

3.  Up  to  a certain  spatial  frequency,  the  increase 
in  the  number  of  clearly  defined  moving  borders  enhances 
the  onset  and  magnitude  of  the  vection. 

4.  The  visually  induced  effect  is  proportional  to 
the  stimulus  velocity  up  to  a saturation  velocity. 

5.  The  time  delay  to  onset  of  visually  induced 
motion  is  highly  variable,  both  among  individuals  and 
for  any  one  individual. 

6.  Brief  vestibular  cues  in  the  appropriate  direc- 
tion hasten  the  onset  of  visually  induced  motion  and  those 
in  the  conflicting  direction  delay  its  onset. 

7.  Continuous  constant  velocity  stimulation  results 
in  a slight  long  term  adaptation  in  the  effect  and  in 
occasional  losses  of  the  visual  effect,  possibly  correlated 
with  eye  movements. 

8.  The  visually  induced  motion  effect  is,  in  most 
respects , identical  to  that  produced  by  the  vestibular 
stimulation  with  the  exception  that  no  sensation  of  accel- 
eration or  deceleration  is  felt  to  accompany  the  observed 
changes  in  velocity. 
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9.  The  frequency  response  of  visually  induced  motion 
effects  depends  upon  the  predictability  of  the  signal;  it 
is  wider  band  for  predictable  than  for  random  motions. 

10.  The  approximate  frequency  response  for  each  of  the 
modes  tested  is  modeled  by  a first-order  low-pass  filter 
with  break  frequency  at  0.1  Hz. 


3.1.3  Dynamic  Model  for  Vection 

For  the  purposes  of  the  Kalman  filter  model,  it  would 
be  desirable  to  have  a model  of  the  visually  induced  motion 
effects  obtained  in  the  absence  of  any  vestibular  stimula- 
tion. This  would  be  apparently  analogous  to  the  vestibular 
models  obtained  for  rotation  in  the  dark.  Unfortunately, 
experiments  on  visually  induced  motion  in  the  absence  of 
any  vestibular  information  cannot  be  performed  on  normal 
subjects  possessing  a functioning  vestibular  system. 

Simply  stated,  either  the  vestibular  system  will  yield 
signals  confirming  the  direction  of  visually  induced  motion, 
as  when  a cab  is  rotated  relative  to  a stationary  surround, 
or,  in  the  absence  of  any  vestibular  stimulation,  the  semi- 
circular canal  and  otolith  cues  will  indicate  that  the  sub- 
ject is  not  accelerating  or  changing  orientation  with  re- 
spect to  gravity,  which  is  a signal  in  direct  conflict  with 
the  visually  induced  motion  sets.  Therefore,  we  are  left 
in  somewhat  of  a quandary  since  the  Kalman  filter  itself 
should  lead  to  the  development  of  the  appropriate  strategy 
for  visual-vestibular  interaction  and  yet  each  of  the 
psychophysical  experiments  upon  which  the  model  is  de- 
veloped involves  vestibular  cues  which  either  confirm  or 
conflict  with  visual  field  motion.  Finally,  to  complicate 
matters  even  further,  the  development  of  visually  induced 
motion  effects  is  a very  strong  function  of  the  mental  set 
of  the  subject.  Having  frequently  experienced  true  motion 
or  visually  induced  motion,  and  being  placed  in  the  situa- 
tion in  which  such  motion  seems  possible  (as  for  example 
in  a movable  trainer) , the  onset  and  strength  of  the  visu- 
ally induced  motion  is  enhanced. 

The  rationale  for  picking  a low-pass  filter  with  break 
frequency  at  0.1  Hz  stems  from  both  linearvection  and  cir- 
cularvection  experiments  with  sinusoidal  random  input  stim- 
uli, and  from  time  domain  recordings  of  the  development  of 
circularvection  or  linearvection  following  a step  change 
in  field  velocity.  In  the  latter  case  as  shown  in  Figure 
3.1  for  circularvection  and  Figure  3.2  for  linearvection. 
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velocity.  (From  Chu,  1976) 


after  the  delay  in  onset,  the  sensation  rises  rapidly  in 
an  almost  exponential  fashion  to  its  final  value  in  a 
period  of  usually  3 to  5 seconds,  consistent  with  a 
first-order  system  having  a time  constant  of  approxi- 
mately 1.5  seconds.  In  the  case  of  vertical  linearvection 
with  a stationary  cab,  we  have  shown  that  the  amplitude 
ratio  and  phase  lag  of  self-induced  velocity  as  a function 
of  field  velocity  breaks  at  approximately  0.1  Hz  but  that 
this  break  is  more  noticeable  and  the  amplitude  ratio 
decreases  more  markedly  when  the  input  is  a random  signal 
as  would  typically  be  the  case  in  most  flight  simulation 
conditions.  Figures  3.3  and  3.4  from  Chu,  (1976)  show 
these  frequency  responses  for  the  linearvection  case.  In 
the  case  of  circularvection , or  rotation  about  a yaw  axis, 
similar  measurements  were  taken  under  conditions  in  which 
the  cab  was  actually  moved  but  subject  to  a vestibular 
simulation  which  was  independent  of  the  visual  field 
motion.  Measurements  of  the  describing  function  between 
visual  input  velocity,  vestibular  stimulus  velocity,  and 
the  presiamed  perception  of  velocity,  as  reflected  in  the 
subject's  control  stick  motions  to  zero  the  cab  velocity, 
yielded  the  manual  control  frequency  responses  shown  in 
Figure  3.5  from  Zacharias  and  Young  (1977).  Some  adapta- 
tion to  prolonged  stimulation  is  also  evident  in  the 
linearvection  experiments  of  Bertoz  et  al  (1975),  in  which 
it  was  seen  that  during  prolonged  stimulation  the  subject 
requires  ever  increasing  field  velocities  to  maintain  a 
perception  of  constant  linear  velocity.  It  was  felt  that 
the  long  term  adaptation  associated  with  time  constants 
on  the  order  of  a minute  or  more  is  not  required  for  the 
initial  modeling  effort. 

Although  the  basic  model  used  in  this  contract  is  a 
linear  Kalman  filter  model,  it  should  be  pointed  out  that 
certain  success  has  been  achieved  in  modeling  visual  in- 
teractions with  a nonlinear  "cue  conflict  model"  in  which 
certain  sensory  channels  are  in  effect  turned  off  when 
their  outputs  are  strongly  in  disagreement  with  those  of 
other  channels.  In  particular,  when  short  term  visual 
transient  information  disagrees  strongly  with  vestibular 
induced  motion  information,  the  visual  information  is 
largely  discarded  until  such  time  as  the  strength  of  the 
vestibular-visual  conflict  is  reduced  (Zacharias  & Young, 
1977) . 
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Figure  3.4a  Vertical  linearvection : frequency  response  to  moving  stripes  with  pseudo- 
random velocity;  gain  vs.  frequency.  (From  Chu,  1976) 
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I 3.1.4  Electrophysioloqical  Measures 

[ 

[ The  psychophysical  measures  reviewed  above  are  more 

‘ reliable,  for  the  purposes  of  modeling  at  the  present 

- time,  than  are  any  physiological  measures  associated  with 

vection.  Although  eye  movement  records,  and  especially 
nystagmus  velocity,  provides  a convenient  measure,  highly 
correlated  with  circularvection,  the  functional  relation- 
ship between  the  two  is  far  from  clear.  At  the  electro- 
physiological  level,  single  unit  recordings  at  various 
sites  in  the  brain  stem  and  cerebellum  have  been  shown 
to  be  influenced  by  visual  field  velocity.  In  particular, 
evidence  is  rapidly  accumulating  to  implicate  the  vestibu- 
lar nucleus  as  a site  at  which  body  rotation  signals  from 
various  sensory  modalities  are  represented,  and  perhaps 
integrated  (see  Henn  et.  al. , 1974;  Dichgans  et.  al.,  1973; 
Thomsen,  1976) . However,  the  case  is  not  yet  made  that 
these  signals  represent  the  visual  input  to  vection  and, 
therefore,  the  modeling  effort  will  remain  primarily  based 
on  the  magnitude  estimate  data. 


3.2  Vestibular  System 

The  vestibular  system  resides  in  a labyrinthine  struc- 
ture behind  the  auditory  portion  of  the  ear.  It  is  com- 
posed of  a set  of  rotation  sensing  organs  known  as  the 
semicircular  canals  and  a set  of  specific  force  sensors 
called  the  otoliths.  These  organs  have  been  studied  ex- 
tensively over  many  years  and  are  the  most  well-defined 
of  the  four  sensory  systems  under  consideration. 


3.2.1  Semicircular  Canals 

The  semicircular  canal  model  used  for  this  work  closely 
follows  the  model  for  canal  afferent  firing  rate  used  by 
Ormsby  (1974)  and  relies  heavily  on  work  by  Young  and  Oman 
(1969)  and  Goldberg  and  Fernandez  (1971).  The  two  sets  of 
canals  are  replaced  by  a single  Cyclopean  set  of  three  canals 
with  sensitive  axes  oriented  as  shown  in  Figure  3.6. 

The  response  of  each  canal  along  its  sensitive  axis  is 
modeled  as  a highly  overdamped  torsion  pendulum  with  added 
afferent  processing.  The  resulting  transfer  function  is 
shown  below. 
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HEAD  COORDINATES  = (xhd.yhd  , zhd  ) 
CANAL  COORDINATES  = (xc,yc,zc) 
OTOLITH  COORDINATES  = (xo,yo,zo) 

Figure  3.6  Cyclopian  Sensor  Coordinates 
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wliere  AFR  = afferent  firing  rate 
a = angular  acceleration 


This  differs  from  Ormsby's  model  only  in  that  Ormsby's  18- 
second  torsion  pendulum  time  constant  has  been  changed  to 
10  seconds  in  order  to  match  more  recent  information,  and 
a .005-second  time  constant  from  the  torsion  pendulum  model 
has  been  omitted.  It  is  not  anticipated  that  there  will  be 
a need  to  use  the  model  at  iteration  intervals  of  much  less 
than  .1  seconds  and  the  .005-second  time  constant  would, 
therefore,  be  invisible. 

The  absolute  canal  threshold  is  usually  talcen  as  the 
acceleration  step  which  a subject  has  a 75%  probability  of 
detecting.  Above  absolute  threshold,  detection  latency  is 
a function  of  angular  acceleration  magnitude.  Figure  3.7 
shows  response  latency  as  a function  of  angular  accelera- 
tion. This  curve  can  be  fit  with  the  equation 


a(T  - T ) = Ic  (3.2) 

r ui 

where  a = angular  acceleration 
T = response  latency 
T^  = reaction  time 

k,.  = constant 

ko)  has  units  of  angular  velocity  and  is  approximately  2®  per 
second.  Thus,  an  angular  acceleration  below  absolute  thres- 
hold will  never  be  felt  while  an  acceleration  above  absolute 
threshold  will  be  felt  only  after  angular  velocity  reaches  k^. 


.1 


rate 

sensitivity 


33 


772^  S 


Figure  3. 7 Adaptation  model  for  subjective  response 
latency  to  constant  angular  acceleration. 
(From  Young  & Oman,  1969) (Used  with  per- 
mission of  Aerospace  Medical  Association.) 
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The  velocity  threshold  is  usually  the  most  important 
one,  and  the  overdamped  quality  of  Equation  3.1  allows  u) 
to  be  associated  with  an  afferent  firing  rate.  Threshold 
has,  therefore,  been  modeled  as  shown  in  Figure  3.8.  THc 
in  Figure  3.8  is  the  afferent  firing  rate  reached  during 
a lO^/sec  angular  acceleration  step  after  .2  seconds  (i.e. , 
when  angular  velocity  reaches  2°/sec) . 


3.2.2  Otoliths 


The  otoliths  are  modeled  using  Ormsby's  Cyclopean  sys- 
tem of  coordinates  shown  in  Figure  3.6.  The  xo  and  yo  axes 
represent  the  utricular  otolith,  while  the  zo  axis  repre- 
sents the  saccular  otolith.  Response  dynamics  along  each 
sensitive  axis  are  modeled  as  an  accelerometer  with  added 
rate  senstivity  presumably  due  to  neural  processing. 

The  transfer  function  used  by  Ormsby  (1974)  is 


AFR  ^ 18000 (s  + . 1) 

sf  (s  + .2)  (s  + 200) 

AFR  = afferent  firing  rate 
sf  = specific  force 


(3.3) 


This  differs  from  a model  proposed  by  Young  and  Meiry  in 
1968,  in  that  the  pole  at  200  rad/sec  in  Equation  3.3  ap- 
pears at  1.5  rad/sec  in  the  Young  and  Meiry  model. 

Fernandez  and  Goldberg  (1976)  recorded  from  squirrel 
monlcey  otolith  afferents  and  found  that  they  could  divide 
units  into  two  populations  based  on  the  regularity  (i.e., 
coefficient  of  variation)  of  discharge  rate.  Regular  units 
(coefficient  of  variation  < .075)  represented  approximately 
70%  of  the  sample,  irregular  units  (coefficient  of  varia- 
tion >.15)  represented  approximately  25%  of  the  sample  and 
the  remaining  units  were  not  clearly  defined. 

Figure  3.9  shows  amplitude  ratio  Bode  plots  of  the 
regular  and  irregular  units  found  by  Fernandez  and  Goldberg, 
and  also  plots  the  Ormsby,  and  Young  and  Meiry  models.  Com- 
parison with  the  Goldberg  and  Fernandez  data  suggests  that 
the  1.5  rad/sec  (.24  Hz)  pole  in  the  Young  and  Meiry  model 
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Figure  3.8  Semicircular  Canal  Model. 
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Figure  3.9  Bode  Asymptote  Plots,  Frequency  vs.  Magnitude  Ratio.  (Steady  state 
gain  has  been  arbitrarily  chosen  as  unity  in  all  three  cases.) 

* Plotted  using  median  values  from  Fernandez  and  Goldberg's  (1976)  data 


may  be  reflecting  a neuromuscular  time  constant  in  the 
response  task  and  should  probably  have  a larger  value. 

The  Ormsby  model  curve  appears  to  be  a reasonable  com- 
promise between  the  two  populations  in  the  Goldberg  and 
Fernandez  neurophysiological  data. 

For  the  purpose  of  the  present  modeling  project  the 
200  radian  per  second  pole  (.005-second  time  constant)  is 
unimportant  since  it  will  be  invisible  for  all  but  ex- 
tremely fast  model  iteration  rates.  It  has,  therefore, 
been  omitted. 

The  accepted  value  for  otolith  threshold  is  approxi- 
mately . 005g  (see  Meiry,  1965;  Young  and  Meiry,  1968; 
Ormsby,  1974) . Modeling  threshold  as  a mechanical  effect 
(as  did  Young  and  Meiry) , leads  to  the  otolith  dyanmics 
shown  in  Figure  3.10. 

A set  of  illusory  effects,  associated  with  static 
orientation  in  certain  specific  force  environments,  have 
been  recognized  for  a long  time  and  are  often  classified 
Aubert,  Muller  and  elevator  illusion  effects  (see  Howard 
and  Templeton,  1966;  Ormsby  and  Young,  1976).  The  net 
effect  of  these  illusions  can  be  generated  by  placing 
the  nonlinearity  shown  in  Figure  3.11  in  the  zo  axis 
(Ormsby  and  Young,  1976) . Although  the  actual  cause 
and  location  of  these  effects  is  not  known,  we  have 
modeled  them  by  arbitrarily  placing  the  nonlinearity 
of  Figure  3.11  in  the  saccule  afferent  response  path 
as  shown  in  Figure  3.12.  Figure  3.12  diagrams  the  com- 
plete otolith  model. 


3. 3 Tactile  System 

The  material  in  this  section  is  derived  primarily 
from  the  new  literature  search  (see  Section  2.0)  and 
is  based  both  on  psychophysical  and  neurophysiological 
data.  The  tactile  model , described  at  the  end  of  this 
section,  is  based  on  three  distinct  and  relatively  well- 
defined  receptors  found  in  hairy  skin  (as  opposed  to 
the  glabrous  skin  of  the  hands  and  feet) . These  recep- 
tors probably  have  the  most  bearing  on  the  situation  of 
primary  interest,  namely  that  of  a person  sitting  in  an 
aircraft  seat.  The  three  receptors  referred  to  are: 

1.  Pacinian  corpuscles  which  are  quickly  adapting 
and  usually  found  in  subcutaneous  tissue. 

2.  Type  I receptors  which  are  slowly  adapting  and 
found  in  the  epidermis. 
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Figure  3.10  Otolith  Dynamics. 
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Figure  3.11  Saccule  Non-linearity  (redrawn  from 
Ormsby  & Young,  1976) . 


3.  Type  II  receptors  which  are  also  slowly  adapting 
and  found  in  the  dermis. 


3.3.1  Tactile  Receptor  Physiology 

3. 3. 1.1  Pacinian  Corpuscle 

Pacinian  corpuscles  are  deep  pressure  sensors  with  a 
rather  distinctive  morphology.  They  are  encapsulated  by 
cylindrical  fluid-filled  sheaths,  or  lamellae,  which  prevent 
static  deformation  from  reaching  the  hard  elliptical  core. 

It  is  this  dendritic  core  that  is  actually  responsible  for 
producing  generator  current  and  thus  the  capsule  acts  as  a 
mechanical  high-pass  filter  of  deformation  stimuli. 

Figure  3.13  shows  a schematic  view  of  a Pacinian 
corpuscle,  as  well  as  a corresponding  mechanical  model. 

The  corpuscles  are  innervated  by  myelinated  afferent  fibers 
and  are  usually  found  in  subcutaneous  tissue  although  they 
sometimes  appear  in  the  lower  parts  of  the  dermis.  Figure 
3.14  shows  such  a corpuscle  in  a section  of  glabrous  skin. 

The  generator  current  needed  to  trigger  nerve  firing 
is  apparently  an  inward  current  caused  by  distention  of  the 
dendritic  core  along  one  of  its  axes  (Loewenstein , 1971) . 

Due  to  the  mechanical  structure  of  the  capsule,  when  a pres- 
sure is  released,  the  core  tends  to  distend  along  the  ortho- 
gonal axis  also  producing  generator  current.  The  net 
effect  is  to  high-pass  filter  and  then  to  rectify  the  actual 
compression  stimulus.  This  is  illustrated  by  the  cellular 
recording  shown  in  Figure  3.15.  As  can  be  seen  in  Figure 
3.15,  Pacinian  corpuscles  show  no  significant  static  re- 
sponse to  compression  stimuli  and  are  quickly  adapting, 
displaying  a time  constant  of  1 to  10  msec. 

Being  deep  pressure  sensors.  Pacinian  corpuscles  have 
a fairly  wide  receptive  field  and  respond  to  stimuli  not 
directly  above  the  corpuscle.  They  are  exquisitely  sensi- 
tive and  respond  to  displacements  as  small  as  10  urn 
(Loewenstein,  1971) . 

3. 3. 1.2  Type  I Receptor 

Type  I tactile  receptors  are  formed  by  myelinated 
fibers  which  end  in  Merkel  cells  very  near  the  skin's  sur- 
face. Merkel  cells  are  found  within  dome-like  elevations 
of  the  epidermis  between  hair  follicles  known  as  Iggo 
corpuscles.  Figure  3.16  shows  an  Iggo  corpuscle  and  a de- 
tail of  one  Merkel  cell  ending. 
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Figure  3.13a  Schematic  view  of  a Pacinian  corpuscle. 

L,  outer  lamellae;  C,  core  lamellae;  the  unmyelinated 
dendrite  is  at  the  center.  The  arrows,  b and  a,  illus- 
trate situations  of  compression  in  the  plane  of  the  minor 
and  major  elliptical  axes  of  the  dendrite  respectively. 
(Lowenstein,  1971)  (Used  with  permission  of  Springer- 
Verlag. ) 


Figure  3.13b.  Mechanical  model  of  the  corpuscle. 


The  model  incorporates  the  main  structural  elements  of 
the  capsule:  rigid  bars  B represent  the  positions  of 
the  lamellae;  springs  M,  their  compliance;  springs  S, 
the  compliance  of  the  weak  lamellar  interconnections; 
and  dashpots  D,  the  resistance  of  the  interlamellar 
fluid  (viscosity  of  water).  (Lowenstein,  1971)  (Used 
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Figure  3.14  Section  of  glabrous  skin.  (From  Mountcastle, 
Vernon  B.:  Sensory  receptors  and  neural  en- 
coding: introduction  to  sensory  processes. 

In  Mountcastle,  Vernon  B.,  editor:  Medical 
physiology,  ed.  13,  St.  Louis,  1974,  The  C.V. 
Mosby  Co.;  courtesy  Dr.  M.E.  Jabaley.) 
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Figure  3.15.  Generator  potential  in  response  to  com- 
pressions of  intact  Pacinian  corpuscle. 
Calibration  is  10  msec  and  50yv.  (From 
Lowenstein,  1971).  (Used  with  permission 
of  Springer-Verlag. ) 
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Figure  3.16a.  Iggo  Corpuscle 


Figure  3.16b.  Detail  showing  merkel  cell  ending.  (From 
Iggo  and  Muir,  1969)  (Used  with  permif  .'.on 
of  The  Physiological  Society.) 
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Type  I receptors  exhibit  highly  focused  receptive 
fields  and  respond  only  to  direct  stimulation  of  the 
touch  corpuscle.  They  respond  dynamically  to  stimuli 
as  small  as  from  1 to  5 mm  of  skin  displacement. 

Figures  3.17  and  3.18  show  typical  time  responses  to 
step  displacements  for  Type  I afferents.  The  step  re- 
sponse adapts  with  time  constants  of  about  1 second  and 
30  seconds.  Type  I receptors  do  show  a static  response 
but  it  is  characterized  by  a highly  irregular  afferent 
rate.  These  fibers  usually  do  not  exhibit  any  resting 
discharge  (see  Iggo  and  Muir,  1969) . 


3. 3. 1.3  Type  II  Receptor 

Type  II  receptors  are  formed  by  myelinated  fibers 
ending  in  lightly  encapsulated  Ruff ini  endings.  The 
end  organ  is  situated  in  the  dermis  but  is  not  as  close 
to  the  skin  surface  as  the  Type  I receptors.  Figure 
3.19  shows  a typical  Ruff ini  ending  in  hairy  skin  of 
the  cat. 

Figures  3.20  and  3.21,  recorded  from  Type  II  re- 
ceptors in  hairy  skin  of  the  cat,  show  typical  time 
responses  of  the  receptors  to  vertical  skin  displace- 
ment. The  semi-log  plots  of  Figure  3.21  can  be  fit 
with  three  adaptation  time  constants  of  approximately 
1,  5 and  20  seconds.  Type  II  receptors  do  exhibit  a 
regular  static  response  as  well  as  a regular  resting 
discharge,  and  have  a relatively  wide  receptive  field 
responsive  to  stretch  (see  Chambers  et  al,  1972) . 


3. 3. 1.4  Comparative  Physiology 

The  receptors  described  in  the  preceding  sections 
appear  to  be  common  to  mammalian  hairy  skin.  Receptors 
with  very  similar  properties  have  been  identified  in 
cats,  monkeys,  humans  and  even  reptiles  (Iggo  & Muir, 
1969;  Knibestol  and  Vallbo,  1970;  Kenton  et.  al. , 1971; 
Chambers  et.  al.,  1972;  Burgess,  1973).  For  example. 
Figure  3.22  from  Knibestol  and  Vallbo  (1970)  shows  a 
recording  from  a receptor  in  human  hairy  skin  that  was 
found  to  closely  resemble  the  cat  Type  II  cutaneous  ' 
receptors  described  in  detail  by  Chambers  et.  al.  (1972) . 
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Figure  3.17b  Step  response  of  Type  I plotted  on  semi-log 
scale.  (From  Iggo  & Muir,  1969) (Used  with 
permission  of  the  Physiological  Society.) 
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Figure  3.18  Step  response  of  cutaneous  afferent  inner- 
vating Iggo  corpuscle  in  hairy  skin  of  cat. 
(From  Werner  and  Mountcastle,  1965) (Used 
with  permission  of  the  American  Physiologi- 
cal Society.) 


Figure  3.19  Lightly  encapsulated  Ruff ini  ending  situated 
in  the  dermis,  in  hairy  skin  of  the  cat. 

(From  Chambers,  Andres,  Duering,  6.  Iggo,  19  72) 
(Used  with  permission  of  Longman  Group  Ltd.) 
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Figure  3.20  Time  response  of  time  unit  to  vertical  displace- 
ment of  the  skin.  A,  single  records.  B,  each  print  is  the  mean 
of  6 recordings;  (a)  resting  discharge;  (b)  dynamic  discharge; 

(c)  adapting  discharge;  (d)  adapted  discharge;  (e)  silent  period; 
(f)  recovery  of  resting  discharge.  (From  Chambers,  Andres,  Duer- 
ing,  and  Iggo,  1972) (Used  with  permission  of  Longman  Group,  Ltd.) 
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3.21  Response  of  Type  II  unit  plotted  on  semi-log 
scale . 

ISI  = interspike  interval. 

ISI„_  i interspike  interval  during  resting 
discharge . 

(From  Chambers,  Andres,  Duering,  & Iggo,  1972) 
(Used  with  permission  of  Longman  Group,  Ltd.) 
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Figure  3.22  Responses  to  skin  stretch  of  a slowly  adapt- 
ing unit  with  irdistinct  receptive  field 
borders  in  the  hairy  skin.  In  the  drawing, 
the  black  dot  indicates  the  point  of  maximal 
sensitivity  of  the  unit.  The  arrows  indicate 
the  directions  in  which  the  skin  was  stretched 
when  the  records  in  A,  B and  C respectively 
were  obtained.  (From  Knibestol  & Vallbo,  1970) 
(Used  with  permission  of  the  Scandinavian 
Physiological  Society.) 
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3.3.2  Psychophysical  Data 

Figure  3.23  shows  human  threshold  to  flutter  vibra- 
tion over  a range  of  frequencies  under  normal  conditions 
and  after  skin  surface  has  been  anesthetized.  Both  curves 
have  a double  limb  characteristic  that  suggests  two  recep- 
tor populations,  one  population  being  sensitive  to  very 
high  frequencies  (the  steeper  sloped  limb)  and  another  to 
lower  frequencies.  This  supposition  is  strengthened  by 
the  effect  of  local  skin  anesthesia.  Skin  anesthesia  en- 
hances the  relative  influence  of  the  high  frequency  sensi- 
tive population  implying  a deep  location  for  these  sensors 
and  a location  near  the  surface  for  the  low  frequency  popu- 
lation. These  results  are  consistent  with  quickly  adapting 
Pacinian  corpuscles  beneath  the  derrois  and  more  slowly 
adapting  cutaneous  receptors  as  described  in  neurophysio- 
logical studies.  In  Figure  3.24  Mountcastle  further  supports 
this  contention  by  superimposing  neurophysiological  tuning 
curves,  from  the  monkey's  hand,  and  human  psychophysical 
data . 

Psychophysical  studies  have  also  shown  that  threshold 
tends  to  decrease  with  increasing  stimulus  area  (Verrillo, 
1966;  Makarov  and  Matoyan,  1968).  These  studies,  however, 
usually  involve  small  probes  of  varying  diameter,  or  air 
jets  covering  a relatively  small  area,  and  it  is  not  clear 
how  to  extrapolate  this  to  the  type  of  wide  area  stimulation 
experienced  in  an  accelerating  aircraft  seat. 

The  shape  of  the  steady-state  input/output  function 
for  tactile  sensation  is  still  not  clear.  Mountcastle 
(Mountcastle,  1971)  has  found  that  linear  functions  provide 
good  fits  to  his  data  for  glabrous  skin  but  that  power 
functions  seem  more  appropriate  in  the  case  of  hairy  skin. 
Kruger  and  Kenton  (1973)  have  disputed  this  contention, 
however.  For  preliminary  modeling  purposes  we  will  assume 
a linear  relation. 


3.3.3  Weber  Fractions  for  the  Tactile  System 

Werner  and  Mountcastle  (1965)  have  calculated  Weber 
fractions  for  mechanoreceptors  innervating  hairy  skin  of 
the  cat,  both  empirically  and  theoretically.  The  curves 
of  Figure  3.25  were  determined  theoretically  by  using 
previously  calculated  input/output  functions.  The  dashed 
line  assumes  the  least  discriminable  response  to  be  always 
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Psychophysical  tuning  curve  for  human  thres 
hold  to  tactile  stimulus — glabrous  skin, 
thenar  eminence.  (From  Mountcastle,  1967) 
(Used  with  permission  of  Rockefeller  Univer 
sity  Press.) 


Figure  3.24  Human  thresho-ld  to  tactile  stimulation. 

Heavy  Lines;  Human  threshold  to  tactile  stimulation — volar 
surface,  distal  phalanx  of  the  finger. 

Light  Lines:  Tuning  points — myelinated  cutaneous  afferents 
ending  in  glabrous  skin  of  monkey  hand. 

Crosses;  Tuning  points — myelinated  afferents  ending  in 

Pacinian  corpuscles  of  monkey  hand. 

(From  Mountcastle,  1967) (Used  with  permission  of  Rockefeller 
University  Press.) 
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Figure  3.25  Weber  fraction  based  on  input/output 

function  calculated  for  mechanoreceptor 
afferent  innervating  hairy  skin  of  cat. 

Dashed  Line:  Assume  least  discriminable  response  incre- 
ment (AR)  is  always  one- tenth  of  the  total 
response  (R) . 

Solid  Line:  Assume  least  discriminable  response  incre- 

ment is  always  5 impulses. 

AS  = Least  discriminable  stimulus;  S e total  stimulus. 


(From  Werner  and  Mountcastle,  1965) (Used  with  permission 
of  the  American  Physiological  Society.) 


1/10  of  the  total  response,  while  the  solid  line  assunves 
that  the  least  discriminable  response  is  always  5 impulses. 

Figure  3.26  shows  some  experimentally  determined 
points  which  contain  the  assumption  that  the  least  dis- 
criminable response  is  6 impulses.  For  the  purpose  of  our 
model  it  is  reasonable  to  choose  a Weber  ratio  between  .1 
and  . 5 


3.3.4  Tactile  Model 


Although  there  is  a lack  of  data  relating  to  wide 
field  tactile  stimulation  or  to  interpretation  of  tactile 
stimuli  in  terms  of  motion  and  orientation,  we  will  propose 
the  simplest  possible  model  that  can  be  extrapolated  from 
available  data.  It  seems  reasonable  that  the  total  informa- 
tion content  at  the  disposal  of  higher  centers  will  be 
limited  by  the  basic  dynamics  of  the  individual  receptors 
even  though  wide  area  stimulation  may  alter  thresholds  and 
noise-to-signal  ratios. 

The  simplest  possible  modeling  scheme  is  a single 
transfer  function,  for  a hypothetical  receptor,  that  in- 
corporates both  the  high  pass  characteristics  of  Pacinian 
corpuscles  and  a smaller  low  frequency  sensitivity  attrib- 
utable to  Type  I and  Type  II  cutaneous  receptors.  Such  a 
scheme  is  shown  by  Figure  3.27  and  is  the  initial  tactile 
model  used  in  our  program. 

The  Pacinian  corpuscles  are  rectifiers  as  well  as 
high-pass  filters  and  no  directional  information  is  avail- 
able from  them.  Some  of  the  slowly  adapting  receptors, 
on  the  other  hand,  do  provide  directional  information. 

The  nonlinear  two  channel  output  allows  the  central  pro- 
cessor (in  the  case  of  our  model  a Kalman  filter)  to  gain 
directional  information  by  noticing  which  channel  the  in- 
formation comes  from,  but  results  in  greater  measurement 
noise  than  would  be  the  case  for  a single  linear  channel. 

Body  seat  compression  dynamics  can  be  modeled  as  a 
spring  dashpot  system  as  shown  in  Figure  3.28  (see  Gum, 

19  73)  . For  initial  trial  of  the  model  the  seat  is  assximed 
to  be  very  hard  since  this  condition  will  maximize  the 
contribution  of  the  tactile  system.  Later  a more  realistic 
seat  compliance  can  be  used,  thus  decreasing  the  effective 
bandwidth  of  the  tactile  system. 
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Figure  3.26  Weber  fraction  (— ) 

S 

Dots:  Based  on  Input/Output  power  function 
calculated  for  mechanoreceptor  affer- 
ent innervating  hairy  skin  of  cat. 

Asterisks:  Points  determined  experimentally 
for  same  unit. 

All  points  assume  least  discriminable  re- 
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3.27  Tactile  Model 


Gum  (1973)  has  modeled  the  buttocks  seat  contact 
surface  using  the  following  spring  and  dashpot  constants: 

= 840  nt  sec/m 
kj^  = 3.17  X 104  nt/m 

Although  these  values  probably  vary  over  different  body 
surfaces,  we  will  use  them  for  all  body  surfaces  until 
additional  data  are  available.  Assuming  a body  mass  of 
approximately  70  kg  will  give  the  transfer  frunction 


Skin  Displacement  9.8 

= m/g  (3.4) 

Specific  Force  2 cc.,  . 

^ s + .56s  453 


Equation  3.4  occupies  the  body/seat  block  in  Figure  3.27. 
Since  there  is  no  good  threshold  information  concerning 
the  broad  area  tactile  stimulus,  we  will  take  threshold 
as  zero  for  the  time  being. 

Figure  3.29  shows  an  alternate,  more  complex 
tactile  model  using  two  completely  separate  channels, 
one  employing  high-pass  dynamics  characteristic  of 
Pacinian  corpuscle,  and  another  employing  more  slowly 
adapting  dynamics  characteristic  of  Type  I and  Type  II 
receptors.  This  model  is  being  considered  for  possible 
implementation  at  a later  date  if  required. 


3.4  Proprioceptive  System 

Proprioceptive  sensors  represent  an  extremely  chal- 
lenging modeling  problem  which  still  requires  a great 
deal  of  additional  work.  It  is  a difficult  sensory  mode 
to  approach  because  it  involves  many  interrelated  joints 
and  muscles,  and  the  afferent  signals  available  to  the 
central  nervous  system  are  not  well  defined.  The  basic 
components  of  proprioceptive  sensation  are  Golgi  tendon 
organs,  muscle  spindles  and  joint  receptors.  Golgi  ten- 
don organs  transduce  muscle  tension  and  Figure  3. 30  shows 
one  model  proposed  for  tendon  organ  response.  Muscle 
spindles  appear  to  be  primarily  muscle  length  sensors. 
Figure  3.31  is  a diagram  of  a typical  muscle  spindle  an'* 
Figure  3.32  shows  a lumped  parameter  model  for  spindle 
function . 
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Figure  3.30  Model  for  Golgi  tendon  organ  function  and 
experimental  result  of  increasing  muscle 
tension.  (From  Houk  and  Henneman,  1967, 
as  modified  by  Oman,  class  notes,  MIT, 
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Figure  3.32  Model  of  neuromuscular  spindle. 

Model  of  neuromuscular  spindle  performing,  essentially,  as 
a muscle  length  sensor.  Series-elastic  element  H2  is  a 
lumped  representation  of  the  nucleated  bags  of  the  spindles 
containing  annulospiral  nerve  endings.  Dashpot  R' , spring 
Hi,  and  force  generator  f^g  model  the  contractile  parts  of 
the  spindle  (the  so-called  intrafusal  fibers) , which  are 
innervated  by  the  ymoto-neuron  system.  The  output,  v(t) 
from  the  annulospiral  or  primary  endings  (transducer)  is 
proportional  to  the  stress  fs  within  the  nucleated  bag, 
which  in  turn  depends  on  muscle  length  and  on  (the 

force  produced  by  intrafusal  fibers).  The  distension  n(t) 
is  beyond  resting  length  of  the  spindle.  (After  Talbot  & 
Gessner,  1973) 
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As  an  initial  attempt  to  include  proprioceptive  input 
in  the  unified  model,  we  have  chosen  to  consider  one  very 
specific  proprioceptive  input.  This  input  is  muscle  spindle 
response  to  lateral  head  motion  with  respect  to  the  body 
trunk.  Gum  (1973)  has  proposed  a model  for  the  head/neck 
control  system  based  on  muscle  spindle  feedback.  This  model 
will  form  the  basis  for  our  first  attempt. 

Figure  3.33  diagrams  the  head/neck  muscle  system  as 
an  inverted  pendulum  with  muscular  control  torques.  Figure 
3.34  shows  Gum's  model  reconfigured  to  fit  the  needs  of  the 
current  effort.  The  diagram  assumes  that  the  system  is  al- 
ways acting  to  keep  the  head  upright  and  that  angles  always 
remain  small.  Muscle  dynamics  and  spindle  feedback  trans- 
fer functions  were  based  largely  on  neurophysiological  data, 
head  natural  frequency  and  damping  ratio  were  determined 
empirically  from  a single  subject,  and  head  moment  of  in- 
ertia (Iji)  was  approximated  by  using  a simple  geometric 
model  (see  Gum,  19  73)  . Neck  joi-^t  receptors  are  not  con- 
sidered, at  least  initially. 

Other  factors  probably  contribute  to  the  head/neck 
control  system  and  need  to  be  investigated  further.  For 
instance,  the  vestibular  sensors,  as  well  as  the  muscle 
spindles  provide  feedback  tending  to  stabilize  the  head. 
There  are  also  proprioceptive  systems  besides  the  head/ 
neck  system  that  are  important  enougir  to  warrant  study  and 
eventual  inclusion  in  a unified  model.  Proprioceptive 
mechanisms  in  the  arms  and  legs  are  of  particular  interest 
for  application  to  aircraft  pilots  since  these  limbs  are 
used  to  manipulate  controls  (joystick,  rudder  pedals,  etc.). 
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I.  is  the  moment  of  inertia  of  the  head  about  the  neck  pivot 
n 

B is  the  damping:  due  to  other  muscles  and  neck  tissue 
n 

not  involved  in  active  motion, 

K is  the  elastance  due  to  other  muscles  and  neck  tissue 
n 

not  involved  in  active  motion, 
is  the  mass  of  the  head, 

r is  the  distance  from  the  pivot  to  the  center  of  mass, 
g is  the  acceleration  due  to  gravity  and 
e is  the  displacement  angle. 


Figure  3.33  Head/Muscle  System.  (From  Gum,  1973) 
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d = muscle  lever  arm  = .075  m 

head  moment  of  inertia  = .0304  kg 

= head  mass  = 4.6  kg 

„ = 7.81  §1^ 

n — sec 

r “ inverted  pendulum  length  = .0498  m 

®^zhd  — specific  force  parallel  to  body  axis 


Sf 


yhd  — lateral  specific  force 


>AFR 


Figure  3.34  Lateral  Head/Neck  Proprioception  Model 
(after  Gum,  1973) . 
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4.0  UNIFIED  MODEL 


Input  from  peripheral  sensor  systems  must  be  integrated 
by  the  central  nervous  system  to  produce  an  innate  awareness 
or  perception  of  orientation  and  motion.  There  are  many 
ways  to  approach  this  as  a modeling  problem.  This  section 
briefly  describes  three  related  models  that  have  recently 
appeared  in  the  literature  and  then  provides  a detailed  des- 
cription of  the  approach  employed  by  the  current  effort. 


4,1  Previous  Models 


In  his  doctoral  thesis,  Charles  Ormsby  (1974)  developed 
a model  for  "human  dyncunic  orientation"  based  primarily  on 
the  vestibular  system.  The  model  uses  Kalman  filters  to 
shape  the  individual  canal  and  otolith  estimates  of  angular 
velocity  and  specific  force  respectively.  A nonlinear  logic 
is  then  used  to  combine  these  canal  and  otolith  estimates 
through  the  use  of  a confirmation  gate.  The  model  is  dia- 
gramed in  Figures  4.1,  4.2  and  4.3.  The  Ormsby  model  has 
so  far  proven  quite  consistent  with  experimental  data. 

Zacharias  and  Young  (1977)  have  proposed  a model  to 
handle  visual-vestibular  interaction  in  the  yaw  rotation 
mode.  The  model  is  diagramed  in  Figure  4.4  and  has  shown 
a good  fit  to  data  obtained  during  a yaw  motion  manual  con- 
trol task. 

Curry,  Hoffman  and  Young  (1976)  have  extended  the  pilot 
optimal  control  model  of  Kleinman,  Baron  and  Levison  (1970) 
to  consider  both  visual  and  vestibular  inputs  to  a Kalman 
filter/predictor.  It  is  closely  related  to  the  present  ef- 
fort but  with  a slightly  different  goal  and  approach.  The 
model  is  designed  for  analysis  of  statistical  parameters  of 
pilot  performance  as  opposed  to  time  domain  outputs  of  per- 
ceptual quantities.  Frequency  analysis  of  the  model  shows 
good  agreement  with  data  gathered  during  a roll-controlled 
tracking  task  for  all  but  the  very  low  frequency  range. 


4.2  Approach  to  Present  Modeling  Effort 

The  goal  of  the  current  effort  is  to  develop  a general 
model  able  to  encompass  four  sensor  system  modalities: 
vestibular,  visual,  tactile  and  proprioceptive.  The  de- 
sired output  of  the  model  is  a time  domain  prediction  of 
orientation  and  motion  perception.  For  an  .initial  attempt 
we  have  assumed  a completely  naive  subject  whose  only  task 
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Figure  4.2  w Estimator  (from  Ormsby,  1974) 
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is  to  try  to  remain  aware  of  his  inertial  state.  Figure  4.5 
shows  a basic  view  of  such  a system.  As  of  this  writing  the 
model  has  been  exercised  only  with  the  vestibular  sensor 
system  components;  however,  work  is  continuing  to  include 
the  other  sensory  modalities  as  well. 

The  sensor  model  blocks  of  Figure  4.5  are  occupied  by 
the  individual  sensor  models  described  in  the  last  section 
and  to  a large  extent  are  physiologically  based.  It  is  not 
possible  to  decode  central  nervous  system  wiring  in  order 
to  deduce  a central  processor  algorithm;  however,  the  prob- 
lem can  be  approached  by  assuming  that  some  sort  of  an  op- 
timization process  is  involved.  If  given  a task  similar  to 
that  of  the  neural  central  processor,  the  simplest  technique 
would  be  to  assume  a linear  system  with  white  input  and 
measurement  noise,  in  which  case  the  optimal  estimator  is 
the  well-known  Kalman  filter.  If,  in  addition,  the  noise 
processes  are  assumed  to  be  stationary,  the  filter  reduces 
to  a steady-state  Kalman  or  Weiner  filter  and  has  the  form 
shown  in  Figure  4.6.  Figure  4.7  is  a generalized  diagram 
of  a Kalman  filter  blending  model  for  motion  and  orientation 
perception. 

There  are  many  other  possible  schemes  that  can  be  used 
to  model  the  central  processor.  A leading  candidate  is  the 
cue  hierarchy  approach  in  which  the  central  processor  relies 
on  a certain  subset  of  available  measurements  depending  upon 
specific  conditions.  A hybrid  scheme  involving  both  linear 
filter  blending  and  cue  hierarchy  switching  is  probably 
closest  to  reality. 

The  Kalman  filter  approach  is,  none  the  less,  very  ap- 
pealing at  this  stage.  It  has  a certain  conceptual  simplicity 
since  conflicting  measurements  are  blended  according  to  a 
mathematical  optimization  algorithm,  and  the  filter  alone  may 
prove  capable  of  matching  available  data  satisfactorily.  It 
has,  therefore,  been  decided  to  pursue  a Kalman  filter  formu- 
lation for  the  central  processor  model.  Since  information 
about  sensor  afferent  response  is  incomplete,  this  still 
leaves  considerable  leeway,  primarily  in  the  choice  of  inter- 
nal model  parameters  and  structure. 

4.3  Structure  of  Unified  Model 

Use  of  the  Kalman  filter  blending  model  involves  two 
basic  operations.  First,  optimal  parameters  for  the  filter 
must  be  derived  based  on  an  "internal  model."  These  para- 
meters are  then  used  in  real-time  implementation  of  the  filter 
to  obtain  time  history  responses  to  deterministic  stimuli. 
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Figure  4.5 


Basic  structure  of  unified  motion  and  orienta- 
tion perception  model. 


Figure  4.6  Continuous,  steady  state  Kalman  filter.  (Redrawn  from  Gelb,  1974) 
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4.3.1  Internal  Model 


The  internal  model  is  the  central  processor's  concep- 
tion or  view  of  the  relation  between  the  real  world  and 
the  biological  sensor  systems.  It  is  used  only  to  derive 
optimal  filter  parameters,  in  our  case  Kalman  gains,  and 
must  be  linear  since  we  are  employing  a linear  filter. 

The  only  a priori  knowledge  specified  by  the  internal 
model  is  an  expected  rms  stimulus  magnitude,  an  expected 
stimulus  bandwidth,  and  an  expected  white  measurement 
noise  of  known  power. 

Figure  4.8  shows  the  internal  model  structure  used 
for  the  "vestibular  system  only"  version  of  the  Kalman 
filter  blending  model.  The  semicircular  canal  and  oto- 
lith blocks  are  defined  by  the  linear  part  of  the  sensor 
models  derived  in  Section  3.2.  All  quantities  of  Figure 
4.8  are  defined  in  the  head  fixed  coordinates  system 
shown  in  Figure  4.9.  The  variables  and  parameters  of 
Figure  4.8  are  defined  as  follows: 


W white  noise  process 

vel  velocity  vector 

acc  acceleration  vector  (in  gravity  units) 

rotation  vector  (integral  of  angular 
velocity)  in  radians 

u angular  velocity  vector 

^ unit  gravity  vector  when  head  is  in 

upright  position 

Ag  linearized  difference  between  current 

unit  gravity  vector  (g)  and  gt) 

sf  specific  force  (=  acc  - £) 

V measurement  noise 

^ neural  afferent  signals. 

Note'  that  the  relations  between  and  w , and  between 
acc,  X sf  ere  accurate  only  for  small  y and  have  been 
linearized  about  a Ig,  head  upright,  condition. 
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Figure  4.8  Internal  Model  with  Vestibular  System  only 


Figure  4.9  Head  Coordinates. 


4. 3. 1.1  Markov  Process 


The  Markov  process,  a white  noise  followed  by  a 
shaping  filter,  is  the  mathematical  way  of  specifying 
bandwidth  and  rms  magnitude  but  no  deterministic  in- 
formation. The  rationale  for  choosing  3 and  input 
power  spectral  density  (WO)  is  to  specify  the  frequency 
spectra  for  the  various  input  quantities  that  might  be 
anticipated  by  the  biological  central  processor. 

With  the  structure  shown  in  Figure  4.8,  3i  and  32 
represent  the  bandwidth  of  y and  vel , respectively,  and 


VIO^  = 163j^^o^^ 


«°2  = ''»2^0vel' 


(4.1) 


At  this  time  we  do  not  have  very  precise  information 
concerning  typical  spectra,  either  during  normal  walking 
and  running  or  in  aircraft.  Preliminary  results  suggest 
a high  sensitivity  of  the  model  to  the  input  spectrum, 
and  the  structure  and  parameters  of  the  Markov  process 
will  probably  be  revised  and  adjusted  as  additional  model 
sensor  systems  are  added  and  validation  continues. 


4. 3. 1.2  Measurement  Noise 


The  basis  for  the  optimal  blending  procedure  is  a 
realization  that  uncertainty  is  associated  with  each 
measurement.  The  linear  filter  assumes  that  the  uncer- 
tainty in  each  measurement  is  due  to  a zero  mean,  white 
disturbance.  The  measurement  noise  variance  can  be  ex- 
pressed in  terms  of  the  noise/signal  ratio  (p)  and  an 
output  variance  (a  2)  as 


V. 

1 


(4.2) 


If  nonlinearities  are  present,  their  effect  can  be 
included  in  terms  of  a describing  function  gain  (see 
Section  4. 3.1. 3).  If  it  is  assumed  that  the  central  pro- 
cessor is  dividing  its  attention  between  several  tasks, 
attention  fraction  may  also  be  included  yielding 
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V. 

1 


2 


( fa^)  ( fn^)  ^ 


(4. 


where  fn  is  a random  input  describing  function  gain  and 
fa  is  an  attention  fraction.  This  is  the  formulation 
used  by  Levison  et.  al.  (1971) . 

Since  we  presently  have  no  data  that  allow  us  to 
unambiguously  distinguish  the  effects  of  p and  fa,  it 
has  been  decided  to  arbitrarily  take  fa  as  1 for  the 
case  of  a subject  whose  only  task  is  to  keep  track  of 
his  orientation.  As  a starting  value  of  p for  the  ves- 
tibular system  contribution  we  have  used  .05,  as  com- 
puted from  Shirley's  data  (Shirley,  1968)  by  Curry  et. 
al.  (1976).  Preliminary  results  using  this  value  ap- 
pear to  be  reasonable  (see  Section  5.0).  As  the  valida- 
tion process  continues,  this  parameter,  along  with  input 
noise  power  and  Markov  process  spectrum,  will  be  adjusted 
to  "tune"  the  model  so  that  it  matches  known  data  as 
closely  as  possible.  Eventually,  when  the  "active  pilot" 
is  considered,  fa  will  be  adjusted  as  a function  of  dif- 
ferential pilot  task  leading. 


4. 3. 1.3  Random  Input  Describing  Function 


Although  the  internal  model  must  be  linear  for  use 
in  calculating  Kalman  gains,  the  biological  central  pro- 
cessor may  have  evolved  to  account,  in  its  estimates, 
for  some  sensor  nonlinearities.  This  can  be  handled  in 
the  model  with  random  input  describing  functions  (RIDFs) . 
An  RIDF  consists  of  a linear  gain  (fn) , chosen  such 
that  expected  rms  input  values  will  result  in  the  same 
rms  outputs  produced  by  the  real  nonlinearity. 

The  proper  value  of  fn  is  determined  by  assuming 
that  input  to  the  nonlinearity  is  gaussian,  and  then 
minimizing  the  mean  squared  error  of  the  describing 
function  approximation.  It  can  be  shown  that  for  a 
non-biased  gaussian  input 
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fn  = 


\/2na^ 


y (x)  e 


(-x^/2 


dx 


(4.4) 


where  x = Gaussian  input 

a = Standard  deviation  of  input 

y = Output  from  the  nonlinearity 
as  a function  of  x 


For  a threshold  nonlinearity  of  the  type  shown 
in  Figure  3.8  and  3.10  this  reduces  to 


fn  = 2{1-PI(™)}  + ™{(2)PF(™)} 


(4.5) 


The  functions  PI  and  PF  are  plotted  in  Figure  4.10. 

For  a rigorous  derivation  of  random  input  describing 
functions  see  Gelb  and  VanderVelde  (1968) . 

In  the  case  of  the  semicircular  canal  model  (see 
Section  3.2.1)  a is  the  standard  deviation  of  the  af- 
ferent output  (calculation  of  covariance  is  described 
in  Section  4. 3. 1.4).  In  the  case  of  the  otolith  model 
(see  Section  3.2.2)  a is  the  standard  deviation  of  the 
state  variable  representing  mechanical  deflection  of 
the  otolith  (calculation  of  state  covariance  is  des- 
cribed in  Section  4. 3. 1.5).  The  saccule  nonlinearity 
(discussed  in  Section  3.2.2)  is  not  represented  by  a 
describing  function.  The  reason  is  that  the  non- 
linearity was  designed  to  produce  the  Aubert,  Muller 
and  elevator  illusion  affects — presuming  the  system 
does  not  try  to  correct  for  the  nonlinearity  when 
making  estimates.  The  filter  is,  therefore,  not 
"told"  about  the  saccule  nonlinearity. 
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Figure  4.10 


Graph  of  PF(x),  PI(x),  and  G(x) . 
(From  Gelb  & VanderVelde,  1968) 
(Copyright  [1968]  by  McGraw  Hill 
Book  Co. , used  with  permission  of 
McGraw  Hill  Book  Co.) 
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4. 3. 1.4  Steady  State  Kalman  Filter  Gain  Calculation 


The  entire  internal  model  of  Figure  4.8  can  be 
expressed  in  state  vector  form  as 

X = A X + E w 
^ = C X + V 


where 


vel 

acc 


X = 


Y 

0) 


_ State  vector  of 
~ dimension  nx 


A = system  matrix  of  dimension  nx  by  nx 

E = input  matrix  of  dimension  nx  by  nw 

y = output  vector  (representing  afferent 
signals)  of  dimension  ny 

C = output  observation  matrix  of  dimen- 
sion ny  by  nx 

V = measurement  noise  vector  of  dimen- 
sion ny  1 j 

nx  = number  of  state  vari2d3les 

nw  = number  of  white  noise  inputs 

ny  = number  of  output  observations 


Appendix  B contains  the  A,  E,  and  C matrices  used  to 
obtain  the  results  shown  in  Section  5.0.  Note  that 
Xf  U/  vel,  and  acc  (see  Figure  4.9)  must  appear  as 
state  variables  since  the  estimates  of  these  states 
will  represent  the  perceptual  quantities  desired. 

The  remaining  state  variables  need  not  have  any  physi- 
cal significance. 

Optimal  steady-state  Kalman  filter  gains  are 
determined  from  the  model  of  Equation  4.6  by  solving 
the  following  well-known  matrix  equations. 


1.  Covaricince  of  state  (X). 

X is  the  solution  of  the  linear  matrix  equation. 

X=0=AX+XA'+EWOE'  (4.7) 

2.  Covariance  of  observation  (Y) . 

Y = C X C (4.8) 

3.  Error  Covariance  of  the  Kalman  filter  (S) . 

S is  the  solution  of  the  Matrix  Riccati  equation. 

S=0=AS+SA'  +EWOE'  -SC  V"^  C S (4.9) 

4.  Covariance  of  the  Kalman  filter  estimate  (XH) . 

Xh  « X - S (4.10) 

5.  Steady  state  Kalman  filter  gain  matrix  (GK) 

GK  » S C V”^  (4.11) 

6.  Filter  system  iratrix  (F) 

F « (A  - GK  C)  (4.12) 
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4.3,2  Time  History  Response  to  Deterministic  Stimuli 

Once  optimal  Kalman  gains  have  been  calculated  the 
filter  can  be  implemented  by  satisfying 


X = F X + Gk  y 


(4.13) 


yi  are  afferent  signals  received  by  the  filter  and  x^ 
are  the  filter’s  estimates  of  internal  model  states. 
Figure  4.11  diagrams  the  time  history  calculation  for 
the  "vestibular  system  only"  model. 

The  linear  portion  of  each  sensor  model  can  be 
represented  in  state  variable  form  as 


X = A X + B u 
y = C X 

where  x h sensor  state  vector 
B E sensor  input  matrix 
u E deterministric  stimulus 
y E afferent  response 
C = sensor  output  matrix 


Equation  4.14  can  be  implemented  on  a computer  by 
the  discrete  formulation 


(4.14) 


x(t)  = $(At)  x(t-At)  + DM(At)  u(t) 


'{’(At)  = e 


rAt 


A At 


DM  = [A  'P(v)  dvjB 


(4.15) 


(4.16)* 


(4.17) 


This  formulation  assumes  that  u(t)  is  approximated  by 
a series  of  At  duration  steps. 


* For  a square  matrix  A,  the  matrix  exponential  is  defined 


as : 


A A^  A^ 

e^=l+A+|r+|r+ 
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-i.gure  4.11  Time  History  Model  with  Vestibular  System  only. 


The  filter  is  implemented  on  the  computer  in  a 
similar  fashion  by  the  relation 


x(t)  = $p(At)  x(t-At)  + DMp(At)  y(t)  (4.18) 

= e^  (4.19)* 

DMp  = [4^^<I>p(v)  dv]  GK  (4.20) 


Y is  transformed  to  either  Euler  angles  or  a DOWN  vec- 
tor for  convenience  in  interpretation.  Euler  angles 
are  expressed  as  the  yaw,  pitch,  and  roll  angles  (from 
outermost  to  innermost  "gimbal"  respectively)  represent- 
ing perceived  orientation  with  respect  to  navigation 
coordinates. t The  DOWN  vector  is  a vector  of  length  Ig 
in  the  perceived  direction  of  gravity,  and  is  expressed 
in  head  coordinates  (see  Figure  4.9). 

Appendix  B lists  all  the  system  matrices  used  to 
obtain  the  results  shown  in  Section  5.0. 


For  a square  matrix  A,  the  matrix  exponential  is  defined 
as:  2 3 

A A A 

e"=I+A+|T+jr+  


t The  navigation  reference  frame  is  defined  by  right-handed 
coordinates  whose  x axis  always  points  north  and  whose 
z axis  always  points  towards  the  center  of  the  earth. 
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General  Time  History  Model.  (Has  not  been  tested  with  visual,  tactile 
and  proprioceptive  components.) 


5.0  PRELIMINARY  RESULTS 


The  computer  program  has  undergone  preliminary  tests 
using  three  relatively  simple  stimuli,  and  considering 
only  the  vestibular  sensors  (semicircular  canals  and  oto- 
liths) . The  internal  model  used  to  calculate  filter  gains 
is  shown  in  Figure  4.8.  The  time  history  model  used  is  the 
one  diagrammed  in  Figure  4.11,  except  that  neither  thres- 
hold effects  or  the  saccule  non-linearities  were  included 
in  test  runs.  It  should  also  be  kept  in  mind  that  the 
model,  in  its  current  form,  assumes  a completely  naive 
subject,  who  has  no  knowledge  of  the  range  of  possible  or 
expected  motion  trajectories.  All  results  shown  were  ob- 
tained using  a model  iteration  interval  of  1 second. 


5.1  Yaw  Acceleration  Step 

Figure  5.1a  shows  a yaw  stimulus  consisting  of  a 
1.5®/sec2  (.026  rad/sec^)  step  of  yaw  acceleration  at 
t = 5 seconds  and  returning  to  zero  at  t = 125  seconds. 

The  stimulus  angular  velocity  vector  is  parallel  to  the 
specific  force  vector.  The  otoliths,  therefore,  provide 
no  information  about  the  stimulus.  Semicircular  canal 
afferent  response,  shown  in  Figure  5.1b,  peaks  after  16 
seconds  and  then  decays  toward  zero,  following  the  trans- 
fer function  of  Figure  3.8.  Note  that  TH^  of  Figure  4.8 
has  been  taken  as  zero  for  this  run. 

Yaw  rate  perception  (Figure  5.1c)  follows  a time 
course  similar  to  that  of  canal  afferent  firing  rate, 
but  peaks  5 seconds  later,  21  seconds  after  stimulus 
onset.  Psychophysical  data  are  qualitatively  consis- 
tent with  Figure  5.1c.  Clark  and  Stewart  (1968)  and 
Guedry  and  Lauver  (1961)  used  stimuli  of  the  same  mag- 
nitude (1.5®/sec2)  and  found  peak  yaw  rate  perception 
at  approximately  35  seconds  and  24  seconds  after  stimu- 
lus onset,  respectively.  The  Ormsby  model  response  to 
an  identical  stimulus  is  shown  by  Figure  5.2  and  peaks 
about  27  seconds  after  stimulus  onset.  The  response  of 
Figure  5.1c  is  quite  reasonable,  although  some  adjust- 
ment of  the  input  spectrum  or  noise/signal  ratio  may  be 
warranted  to  create  a slightly  slower  response. 
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5.2  Forward  Acceleration  Step 

Figure  5.3  shows  the  model  response  to  a .2g  step  in 
forward  acceleration.  The  stimulus  causes  the  specific 
force  vector  to  elongate  and  to  rotate  approximately  .2 
’ radians  with  respect  to  head  fixed  coordinates.  This 

rotation  is  signaled  by  the  otoliths  (see  Figure  5.3c). 

The  head,  however,  has  not  rotated  with  respect  to  in- 
ertial space  and  the  semicircular  canals  maintain  a zero 
signal. 

The  model  initially  "trusts"  the  canals  and  attributes 
the  specific  force  change  to  acceleration  (see  acceleration 
perception  curve  in  Figure  5.3a).  The  initial  acceleration 
perception  then  decays,  and  is  replaced  by  a pitched-back 
sensation  (see  Figure  5.3a).  In  the  steady  state,  the 
specific  force  direction  is  attributed  primarily  to  pitch 
orientation,  or  stated  another  way,  specific  force  direc- 
tion is  perceived  to  be  the  direction  of  gravity. 

This  type  of  response  has  long  been  observed  by  pilots 
during  aircraft  catapult  lavinchings.  Cohen  et.  al.  (1973)  , 
using  centrifuge  simulations  of  the  catapult  launch,  have 
obtained  psychophysical  data  documenting  a pitch-back  sen- 
sation during  forward  acceleration. 

Figure  5.3b  indicates  that  there  is  never  a very  sig- 
nificant feeling  of  pitch  velocity,  (the  semicircular 
canals  continue  to  signal  zero  velocity)  and  pitch  rate 
is  not  consistent  with  pitch  attitude  perception.  We  pre- 
sently know  of  no  data  against  which  to  check  Figure  5.3b 
(angular  velocity  perception) . The  magnitudes  shown  in 
the  figure  are  actually  below  the  resolution  of  most  psycho- 
physical data.  There  are,  however,  well-documented  situations 
which  produce  discrepancies  between  perceived  orientation  and 
perceived  angular  rate.  A most  dramatic  instance  occurs 
during  visual  circularvection  about  a horizontal  axis.  This 
stimulus  causes  the  subject  to  feel  a constant  tilt  angle 
with  respect  to  gravity,  and  the  contradictory  sensation 
of  constant  horizontal  angular  velocity. 

As  in  the  case  of  the  yaw  stimulus,  the  responses  of 
1 Figure  5.3a  appear  qualitatively  correct,  but  validity  of 

1 the  time  constants  and  magnitudes  cannot  be  determined 

[ quantitatively  from  Figure  5.3.  A more  quantitative 
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analysis  can  be  performed  by  precisely  inputting  the 
Cohen  et.  al.  (1973)  catapult  launch  simulation  profile, 
and  comparing  model  output  with  those  results.  In 
addition,  the  frequency  response  of  the  model  output 
can  be  determined  and  compared  with  Young  and  Meiry's 
(1968)  velocity  perception,  frequency  response  data. 


5.3  Pitch-Up  to  Constant  Angle 

A trapezoidal  pitch  rate  stimulus  was  used  to  bring 
pitch  angle  to  .2  rad  over  a 3-second  period  (see  Figure 
5.4a).  Responses  are  evoJced  from  both  the  semicircular 
canals  and  the  otoliths  during  this  stimulus  (Figures 
5. 4c  and  5.4d)  , with  the  semicircular  canals  responding 
to  pitch  specific  force  direction.  Note  that  at  a pitch 
of  .2  rad  (11.5°)  the  specific  force  vector  has  the  same 
orientation  with  respect  to  head  coordinates  as  during 
the  . 2g  acceleration  step. 

Steady-state  perception  of  pitch,  pitch  rate  and  for- 
ward acceleration  (Figures  5.4a  and  5.4b)  are  the  same  as 
the  steady-state  response  to  the  . 2g  acceleration  step 
(Figures  5 . 3a  and  5 . 3b) . The  initial  response,  however, 
is  quite  different.  Pitch  perception  (Figure  5.4a)  now 
closely  follows  the  time  course  of  the  pitch  stimulus, 
pitch  rate  perception  (Figure  5.4b)  is  consistent  with 
attitude  perception,  and  there  is  no  longer  a large 
initial  perception  of  acceleration  (Figure  5.4a).  The 
semicircular  canals  have  effectively  "told"  the  system 
that  the  initial  change  in  specific  force  direction  is 
due  to  a change  in  pitch  attitude,  rather  than  forward 
acceleration,  and  the  stimulus  is  correctly  interpretted 
as  such  from  its  onset. 

Experimental  evidence  does  indicate  that  people  are 
able  to  trade  both  angular  velocity  and  changes  in  their 
orientation  with  a fair  degree  of  accuracy.  Figures  5.5 
and  5.6  are  examples  of  subjective  orientation  angle  and 
angular  velocity  trac)eing  results. 

The  steady-state  pitch  perception  in  Figure  5.4a  is 
smaller  than  true  pitch  but  is  within  the  standard  devi- 
ation of  most  psychophysical  data.  The  literature  con- 
tains a substantial  amount  of  data  concerning  orientation 
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Figure  5.4 
(Cont'd.) 


perception  for  a range  of  static  roll  and  pitch  angles 
in  different  specific  force  environments  (Cohen,  1973; 
Schone,  1964;  Tang,  1974) , and  the  model  must  be  care- 
fully compared  with  these  results.  A good  fit  may 
necessitate  inclusion  of  the  saccule  nonlinearity  shown 
in  Figures  3.11  and  3.12. 


6.0  CONCLUSION  AND  RECOMMENDATIONS 

6.1  Conslusion 

Our  goal  has  been  to  lay  the  groundwork  for  a unified 
motion  and  orientation  perception  model  based  upon  integra- 
tion of  several  different  sensory  modalities.  The  litera- 
ture has  been  surveyed  for  available  material  concerning 
vestibular,  visual,  tactile,  and  proprioceptive  systems  as 
they  relate  to  perception  of  motion  and  orientation.  Al- 
though there  are  certainly  gaps  in  our  knowledge,  a great 
deal  is  already  known  about  how  the  visual  and  vestibular 
systems  act  individually  and  how  they  interact  to  influence 
subjective  orientation  and  motion.  This  material  has  been 
reviewed,  and  is  presented  along  with  the  individual  vision 
and  vestibular  system  models  considered  to  be  best  suited 
to  the  problem  at  hand. 

The  tactile  and  proprioceptive  modalities  are  less  well- 
defined  in  terms  of  their  relation  to  motion  and  orientation 
perception.  A computer  literature  search  was  conducted  in 
order  to  help  identify  available  mechanoreceptor  data.  A 
tactile  model  has  been  proposed  based  on  the  observed  dy- 
namics of  three  distinct  peripheral  receptors,  two  of  which 
are  found  near  the  skin  surface  and  a third  in  subcutaneous 
tissue.  The  proposed  model  is  aimed  at  analyzing  the  effect 
of  seat  pressure  acting  against  various  body  surfaces.  More 
data  is  needed,  however,  pertaining  to  wide  area  stimulation 
of  skin  surfaces  and  subjective  interpretation  of  such  stimuli. 

The  proprioceptive  system  is  perhaps  the  least  well- 
defined  of  the  four  modalities.  It  presents  an  especially 
difficult  modeling  problem  because  it  is  present  at  many 
locations  over  the  body  and  involves  different  mechanical 
structures  at  each.  As  an  initial  attempt  to  include  proprio- 
ception in  a unified  model,  an  adaptation  of  Gum's  (1973) 
head/neck  system  model  is  proposed. 

A detailed  structure  for  a unified  model  has  been  out- 
lined, using  a Kalman  filter  blending  approach  to  integration 
of  different  sensory  modalities.  The  model  structure  has  been 
translated  into  a flexible  FORTRAN  IV  computer  program,  de- 
signed to  output  time  history  predictions  of  perceptual  quan- 
tities given  a time  doman  stimulus  profile. 

Preliminary  trials  of  the  program  are  quite  promising 
but  have  so  far  included  only  the  vestibular  sensors  (semi- 
circular canals  and  otoliths)  and  have  not  yet  considered 
threshold  phenomena.  Ongoing  work  is  directed  at  further 
exercise  and  validation  of  the  vestibular  portion  of  the 
model,  as  well  as  implementation  of  the  additional  moTlal- 
ities.  Modifications  are  expected  as  this  work  is  pursued. 
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6.2  Reconunendations  for  Additional  Study 


The  required  data  concerning  receptor  physiology 
and  the  results  of  sensory  interaction  is  by  no  means 
complete.  Additional  data  in  the  following  areas  would 
be  extremely  helpful  to  modeling  efforts; 

1.  Conflicting  Otolith  and  Semicircular  Canal  Cues. 
There  are  several  basic  motion  cue  situations  that  com- 
monly occur  in  aircraft,  but  are  never  experienced  during 
normal  walking  and  running.  It  would  be  useful  to  have 
more  complete  psychophysical  data  concerning  acceleration, 
orientation,  and  angular  velocity  perception  during  sus- 
tained acceleration.  Such  data  would  be  especially  useful 
during  "coordinated"  maneuvers. 

2 . Visual-Vestibular  Interaction  During  Rotation 
About  a Horizontal  Axis.  There  is  significant  work  in 
the  literature  describing  horizontal  circularvection  com- 
bined with  various  static  orientation  angles.  The  dynamic 
interaction  between  horizontal,  inertial  and  visual  field 
rotations  needs  further  study. 

3.  Broad  Surface  Area  Tactile  Stimulation.  The 
tactile  cue  processing  model  currently  employed  is  based 
primarily  on  data  generated  from  neural  recordings  or 
vibrotactile  threshold  measures  in  which  small  area 
stimuli  were  applied  to  the  forearm  or  hand.  The  tac- 
tile cues  of  importance  in  motion  simulation,  however, 
include  broad  area,  low  frequency  contact  forces  between 
the  seat  and  the  pilot's  legs,  buttocks  and  back.  The 
use  of  a "g-seat"  permits  one  to  vary  the  surface  dis- 
tribution if  not  the  total  magnitude  of  supporting  force. 
Study  is  required  of  the  relationships  among  pressure 
threshold,  surface  area  and  psychophysical  frequency  re- 
sponse to  tactile  stimuli  applied  to  these  load  bearing 
areas.  Such  experiments  require  the  use  of  a controlled 
displacement,  variable  frequency  vibrator,  capable  of 
applying  and  recording  various  pre-load  forces,  and 
equipped  with  contact  heads  of  various  sizes.  Finally, 
definitive  studies  are  required  to  generate  the  data  base 
for  g-seat  generated  sensations  of  tilt  or  linear  acceler- 
ation, in  the  presence  or  absence  of  associated  platform 
motion. 


4.  Typical  Angular  and  Translational  Velocity  and 
Acceleration  Spectra.  Since  the  Kalman  filter  estimator 
is  very  sensitive  to  assumed  input  spectra,  it  would  be 
particularly  useful  to  have  more  complete  information 


about  such  spectra  during  aircraft  flight  (perhaps  broken 
down  by  type  of  aircraft  and/or  type  of  mission) , and 
during  normal  walking  and  running  motions. 

5.  Effects  of  Pilot  Workload  and  Level  of  Training 
on  Threshold  of  Motion  Detection.  Thresholds  for  human 
detection  of  angular  and  translational  accelerations  play 
an  important  role  in  simulator  motion  drive  design,  and 
their  accurate  representation  will  also  significantly 
enhance  the  utility  of  sensory  system  models.  Most  thres- 
hold figures  currently  available  represent  optimal  detec- 
tion conditions  and  may  be  unrealistic  for  application  to 
a busy  pilot  performing  demanding  tasks.  Experiments  are 
needed  to  clarify  the  effect  of  workload  and  pilot  skill, 
so  that  thresholds  can  be  properly  incorporated  in  per- 
ception models  and  applied  to  simulation  problems.  For 
excimple,  pilots  with  different  experience  levels  may  be 
asked  to  signal  their  first  feeling  of  angular  motion 
while  continuously  performing  a visual  tracking  task  of 
varying  difficulty.  At  each  level  of  pilot  skill  and 
side  task  difficulty,  threshold  can  be  determined  accord- 
ing to  a standard  double  staircase  technique  for  approach- 
ing the  minimum  detectable  level  from  above  and  below. 
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-3. 
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0. 
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— 0- 
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0.  0. 

St 
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0. 

.4025E-01 

-0. 


3. 

0. 

-0.- 


0. 


0. 


0. 

.8263 
0- 


0. 


3. 


0. 

C. 

-IL.- 


0. 

C. 


-.4Q25E-01 

0. 

--.-4-J52-£-4Tl- 


.1352E-0>  0. 

3.  .8137 

0.—  ■ .418  4 E - Oi 


0.  0. 

.99S2£-d3  -.6725 

-ft, 3^ — 


0. 


0. 
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0. 


r» 

0.  0. 

.1846E-33  -.3683 

‘,^9266-04 ^ 

0. 


.9220 

0. 

Br 


3. 


3 


.1216 

-6-, 


0. 


0. 
0. 



.'4384E-Q2  C. 


0. 

0. 

-.7952- 


3. 

0. 


-.1345E-02 
— 0. 

0. 


0. 


3. 

--.-83’52- 


0. 

.3694E-05 

-0, — 


0. 

O'. 

-0^ 


c. 


G. 

-.592SE-C1 


-0. 

0. 

0. 

0. 


0. 


.7  998 
.0^ 

0. 


0. 

0. 

0.- 

0. 

-0.- 

0. 


.2383E-02  -.9394 

‘•1438 0 . 

0.  -.5156E-01 


0.  .3296E-Q3  0. 

0.  0.  .7952 

^.-488V-E-^2 6. •-t345£-0  2 

-.3684E-05  0.  0. 

0.  .2371E-02  -.8333 

.32^6E-fr3- 0. ^ — 0, 

-.5532E-01  3.  ). 

0.  .4397E-02  ^O* 

0-. 0-. O'. 

0 . 0.  0. 

3.  0.  3. 


9^. 


0. 

.1C93E-31  0.  G. 

- 0. -.l941i-04--  .6199 

0 . 0 . 0 . 

0.  -.1439  0. 

0, 

0.  0. 

0 . 0 . 0 . 

0 . — ■ 5 1 — — — .3357w-02 


-.5833^ 

0. 


-.8659E-02 

-0. 


0. 

0. 

-3^- 

0. 


-.3357E-02 
0.  -.5833 

- -.5156E-01  0. .1393E-01- 

.9659^-02  0.  0. 

-.ltt4lE-03  .6L99 

0. (U 
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-40- 


11 


12 


-.5726 

- 0. - 

0. 

-.2193i-04 


0. 

0, 

c, 

.5914 
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3. 

(i,  — 


u • 

0. 


-.6743E 

0. 

0. 

0. 


-a... 


0. 

0. 

— 0.  — 
0. 

.2477 

__  0. 

.7060 

0. 

0. 


-.2077- 

0. 


0. 


-.6292E-01  0. 

4.  .2256  0. 

0, 0, .7652E 

0.  -.2422E-0X  0. 

0.  0.  -.7617E-W1 

- -.i292E-0t  C. C. 

0.  0.  .2236 

-.7652^-01  .2673  0. 

0. 0. .2422E 

0 . 0 . 0 . 

0.  3.  0. 

.W6 a. 

0.  0 . 0 . 

0 . 0 . 0 . 

--.610S 0. 0. 


0. 


0. 

-0. 

.3683 

0. 


0. 

'01  0. 

. 0.-  -- 

0. 

0. 

— , 76171-01 
.7360 
0. 

■03 .^373 

0. 

3. 

0. 

3. 

3. 

.01 0. 

3. 

0. 


-^1309 


0. 

0. 

0»- 

0. 

.6108 


M . 

0. 

-<u- 


-.2348E-01 
.4936E-32 
-O-. 


-. 5662E-01 
0.  .5561 


0. 

C. 

-.574-5&- 

0. 


-.5442E 
-—•-5561 — 


-01 


-03- 


-.1331 

0. 

-^764 


15 


-IS- 


17 


18 


-.1301 

0. 


0.  0. 

.5715E-63  -.4764 


.4956E-02  0. 

0.  0. 

--.56&2E-04 ^r- 


3. 


0. 

-0. 

.7148 

0. 


0. 

>^4h30-6- 


0. 

-0-.- 


0. 

0. 


3. 

0. 


0. 

0. 


--v94^4E-62^ 
•01 


0. 

-.6308E' 


-0.- 


-0-.- 


0. 

0. 

-i;-o4yo- 


0.  0. 

-.3347E-15  0. 

—0-, IK- 


0. 

-.9343E-01 


0.  0. 

0.  0. 

.8054E-81 0. 

-•2168E-C1  0.  b. 

0.  .9996  .2086 

0 . 0.1 — 0 . 

-.4494E-01  . 0.  0. 

0.  .4364E-33  , 0. 

.20133-02 0. 0. 

0.  -.3977E-03  .1359 

0 . 0 . o._ 


0. 

0. 

0. 

0. 

-.1127 

0 , 

.1968E 

0. 

,6902E 

-.1880 

0. 

.^093£ 

0. 

-.7456E 


0. 

.4020E* 



.1273E' 


15 

15 


3. 


-Cl 


_0. 

0. 

0. 

■02 0-.- 

3. 

0. 

■02 0.- 

3. 

■03  0. 
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0. 

0, 

0. 

a. 

a. 

0. 

0. 

a. 

0. 
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0, 

0. 
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-0,--  

•.1B19 

0. 
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0. 

0. 

0. 

0. 

-•4494C-01 


0. 



0. 

.>709 

._4). 

0. 

0. 
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0. .999& .ZOS& 
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B.  ).  -.1830 

. 4 384£-  03 d. — .^9-t3  E - 
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^7436  E-  83 0. 0 . 

-.3344E-01  0.  ). 

C.  .5151E-01  0. 

0. 0. 0-. 

9.  0.  0. 

0 . 0 . 0 . 

--.493iE-31 3. J. 

0.  -.4042E-02  0. 

0.  0.  0. 
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0. 
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.169a£-Q2 
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0. 


0. 

0. 
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-a. 8^-0  3- 


-.109iE-01 
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-.9810E-02 


11  -•5212E-02 

0, 
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0. 

14  .8795E-02 

0. 
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-.8654E- 
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,1584;* 

17  .1352E-01 

— 0. - 

18  .1445E-01 

0. 

-19— 0.  

0. 
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,-524iE«42- 


0. 

02 

— .879Si-32- 


• .2427E-fr2— - 


, 
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.1445E-01 


-.2827E-02 
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0. 
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INDIVIDUAL  SENSOR  SYSTEMS:  iteration  interval  - 1 sec 


SeNSO  »-  S Y S T-E-H- tINr  A <-0  Y ^ A M I uS- 

- IMIT.  STATES  CX) 

- SYST.  MTX  (Al 

- OUTPUT  MTX  (C) 

- TSAMSITIOM  MTX  <TMI 

tlVlNG  - HT-X— (T)M » 


SEMICIRCULAR  CANALS 


*3 

1 0. 

i 0* 


1 0.  1.000 

2 .1331 


C. 


l.OCC 


CC 

1 . -.19t]^P'-02  57. ir  .572*4 


TMC 


4_  ,g9Jjv  - .9357 

2 -.3119E-02  .3737 


QMS 

^V78A .9357 
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OTOLITHS 

I xo i 

r i 

f 1 -2.113  0.  4.5S2  i 

t 

AO 


.20CC 


BO  i 

1,000 ^ j 

i 

. 3 


1 -9.000  90.00 

- - - , 

TMO 


.8187 


DM0 

,906^ 


[ 

f 


SENSOR  SYSTEM  THRESHOLDS  (TH) 
THC  =-0. 

— THO---0.  - - 
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